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Box No. I Basis of the report m 

1 . With regard to the language, this report is based on the international application in the language in which it was 
filed, unless otherwise indicated under this item. 

□ This report is based on translations from the original language into the following language , 
which is the language of a translation furnished for the purposes of: 

□ international search (under Rules 12.3 and 23.1 (b)) 

□ publication of the international application (under Rule 12.4) 

□ international preliminary examination (under Rules 55.2 andybr 55.3) 

2. With regard to the elements* of the international application, this report is based on (replacement sheets which 
have been furnished to the receiving Office in response to an invitation under Article 14 are referred to in this 
report as "originally filed" and are not annexed to this report): 



Description, Pages 

1-21 filed with the demand 

Claims, Numbers 

1 -7 filed with the demand 

Drawings, Sheets 

1 n-117 as originally filed 

□ a sequence listing and/or any related table(s) - see Supplemental Box Relating to Sequence Listing 

3. E3 The amendments have resulted in the cancellation of: 

IS the description, pages 22-24 

□ the claims, Nos. 

□ the drawings, sheets/figs 

□ the sequence listing (specify): 

□ any table(s) related to sequence listing (specify): 

4. □ This report has been established as if (some of) the amendments annexed to this report and listed below 
had not been made, since they have been considered to go beyond the disclosure as filed, as indicated in the 
Supplemental Box (Rule 70.2(c)). 

□ the description, pages 

□ the claims, Nos. 

□ the drawings, sheets/figs 

□ the sequence listing (specify): 

□ any table(s) related to sequence listing (specify): 

* If item 4 applies, some or all of these sheets may be marked "superseded. " 
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Box No. II Priority ■ 

1 . □ This report has been established as if no priority had been claimed due to the failure to furnish within the 

prescribed time limit the requested: 

□ copy of the earlier application whose priority has been claimed (Rule 66.7(a)). 

□ translation of the earlier application whose priority has been claimed (Rule 66.7(b)). 

2. □ This report has been established as if no priority had been claimed due to the fact that the priority claim has 

been found invalid (Rule 64.1). Thus for the purposes of this report, the international filing date indicated 
above is considered to be the relevant date. 

3. Additional observations, if necessary: 
see separate sheet 



Box No. V Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial 
applicability; citations and explanations supporting such statement 



1. Statement 



Novelty (N) 


Yes: 


Claims 


1-6 




No: 


Claims 


7 


Inventive step (IS) 


Yes: 


Claims 


2,4-6 




No: 


Claims 


1,3.7 


Industrial applicability (IA) 


Yes: 


Claims 


1-7 




No: 


Claims 





2. Citations and explanations (Rule 70.7): 
see separate sheet 



Box No, VIM Certain observations on the international application 

The following observations on the clarity of the claims, description, and drawings or on the question whether the 
claims are fully supported by the description, are made: 

see separate sheet 
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Re Item II 
Priority 

The priority claimed for the European patent application Nr. 04008969.0 seems to be 
spurious as that document contains completely different subject-matter than the current 
application. Thus the claim for priority is only valid for subject-matter present in the current 
application and originally disclosed in the other claimed priority document, European 
patent application Nr. 03300181.9. 

Re Item V 

Reasoned statement with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

1 . The following documents (D) are referred to in this communication; the numbering 
according to the order in the search report will be adhered to in the rest of the 
procedure: 

D1 : WO 00 26857 A (PIXAR ANIMATION STUDIOS) 1 1 . May 2000 (2000-05-1 1 ) 
D2: US-A-4 979 032 (EASTMAN KODAK CO) 1 8. December 1 990 (1 990-1 2-1 8) 
D3: EP-A-1 237 379 (EASTMAN KODAK CO) 4. September 2002 (2002-09-04) 

2. The present application does not meet the criteria of Article 33(1) PCT, because the 
subject-matter of claims 1 does not involve an inventive step in the sense of Article 
33(3) PCT. 

3. The document D1 is regarded as being the closest prior art to the subject-matter of 
claim 1 , and discloses (when interpreted according to the clarifications suggested 
below; the references in parentheses applying to this document): 

A method for the color correction of digital image data (RGB), said digital image data 
being intended for display by spectral absorption of white light in color filters using a 
first representation means, the method comprising the following steps: 
(a) detection of the primary color values of the image data (RGB), the primary color 
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values being related to the first representation means, 

(b) correction (p. 7, 1. 8-1 1 ; "RGB-RGB Monitor-to-Film Mapping"-206-Fig.2; 1 20- 
Fig.1) of the primary color values in order to generate secondary color values for 
display on an a second representation means, and which take account of the 
absorption of light in secondary densities of the color filters (As commonly 
known, by reading the absorption spectra for the different color filters and by 
using the results for the correction, the absorption of light in secondary densities 
of the color filters is taken account of.) 

wherein 

(c) a plurality of absorption spectra are generated for different densities of at least 
one color filter (p. 6, 1. 26 - p. 7, 1. 1 : the disclosed partitioning of the RGB color 
space into 10x10x10 different color values includes 10 different densities for 
each of the different color filters represented in the R, G and B axes) and 

(d) the spectral profile of the absorption spectra of the color filters influences the 
correction of the primary color values for generating the secondary color values 
(p.7, 1. 3-4: The disclosed conversion of spectra into XYZ values according to 
the CIE standard corresponds, as is commonly known, to the convolution with 
the spectral perception curve of the standard observer as claimed in claim 5). 

4. The subject-matter of claim 1 therefore differs from this known D1 in that D1 does not 
unambiguously state in which branch, i.e. for which of the two representation means 
the data are corrected, while in the current application the data for the monitor are 
corrected to match the film projection. 

5. The problem to be solved by the present invention may therefore be regarded as 
whether the image data should be corrected for the monitor branch or for the film 
reproduction branch. ' 

6. The solution proposed in claim 1 of the present application cannot be considered as 
involving an inventive step (Article 33(3) PCT) for the following reasons. 

A skilled person trying to implement D1 would correct either the image data for the 
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monitor or for the film reproduction. This corresponds to a design decision which can 
depend on several factors. For example, if the image data for the film reproduction 
were corrected, the color gamut could get limited in the correction step for the film 
projection and color details created by the colorist who would be using the full color 
gamut of the monitor might get lost. These considerations would lead the skilled 
person towards the solution of performing the correction in the monitor branch, as 
disclosed in a similar application in D3 (20, 25, 30, Fig. 1). Using this solution, which 
coincides with the solution proposed in claim 1 , the color gamut displayed on the 
monitor would already be limited to the color gamut of the film projection and the 
colorist could only edit color details that remain visible in the film projection. 

7. The present application does not meet the criteria of Article 33(1) PCT, because the 
subject-matter of claim 7 is not new in the sense of Article 33(2) PCT. 

The document D2 is regarded as being the closest prior art to the subject-matter of 
claim 7, and discloses (the references in parentheses applying to this document): 

A video system (Fig. 3) comprising an input for receiving incoming video data 
characterized by a first set of color characteristics (78A.B); at least one output for 
delivering outgoing video data to a display device, said outgoing data characterized 
by a second set of color characteristics (80A-D; 82); a database (76) storing a 
plurality of sets of color characteristics (78A.B; 80A-D, 82); a processor (16) coupled 
to the database (76) for converting the incoming video data into outgoing video data 
based upon at least one set of said sets of characteristics stored in the database (col. 
7, 1. 59 - col. 8, 1. 32). 

8. Claim 3 does not meet the criteria of Article 33(1 ) PCT, because the subject-matter of 
claim 3 does not involve an inventive step in the sense of Article 33(3) PCT: 

D1 discloses generating a plurality ("10 steps along each axis", p. 6, 1. 26-27) of 
absorption spectra for all the color filters (spectra are generated for each patch, thus 
also for the patches on one of the axe). Thus also 
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9. The combination of the features of dependent claim 2 and independent claim 1 , 
assuming the clarifications set out below, is neither known from, nor rendered 
obvious by, the available prior art. The reasons are as follows: 

D1 does not disclose or hint at calculating intermediate spectra. In D1 , only the 
measured spectral data are used in order to establish the mapping from RGB to XYZ 
data. 

Re Item VIII 

Certain observations on the international application 

1 0. The first paragraph in Claim 1 is not supported by the description contrary to the 
requirements of Art. 6 PCT, for according to claim 1 the claimed method for color 
correction relates to "image data generated by spectral absorption of white light in 
color filters of a first representation means". In the description however there is no 
hint to the fact that the digital image data that are to be corrected are generated by 
spectral absorption. 

For the purpose of establishing an opinion regarding novelty and inventive step, the 
opening of claim 1 is interpreted as follows: 

"A method for the color correction of digital image data, said digital image data being 
intended for display by spectral absorption of white light in color filters using a first 
representation means, for display on a second representation means, the method 
comprising the following steps:" 

11. In claim 7, the wording "converting said incoming video data into outgoing video data 
as a based upon at least on of said sets" is syntactically obscure, contrary to the 
requirements of Art. 6 PCT. For the purpose of establishing an opinion regarding 
novelty and inventive step, the passage is interpreted as follows: "converting said 
incoming video data into outgoing video data as-a-based upon at least on one of said 
sets". 
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METHOD AND DEVICE FOR THE COLOR CORRECTION OF DIGITAL 

IMAGE DATA 



5 



FIELD OF THE INVENTION 



The invention relates to a method and also a device for the color correction of digital 
image data: 



What is of crucial importance to the viewers of films, motion pictures, and television 
productions, besides picture sharpness, is the subjective color impression, 
is Therefore, In the course of producing the productions, It is endeavored to ensure 
that the colors, when reproduced for a viewer on a display device, for example, at 
the cinema, on a television screen, and on other display devices, as far as possible 
appear in the way that the director intended. 

20 Therefore, there is a need for devices and methods for color correction and 
management which, in comparison with the prior art, achieve an improved 
correspondence between artistic intention, the colors as they appear during 
reproduction, the colors displayed to a viewer, and the color impression of the 
viewer, regardless of representations, methods, and devices employed during the 

25 production process. 
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BACKGROUND OF THE INVENTION 
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SUMMARY OF THE INVENTION 

The invention provides a system for managing color characteristics of Images 
displayed by a display device on a display screen. 



BRIEF DESCRIPTION OF THE DRAWINGS 



The drawings illustrate facts which serve to provide a better understanding of the 
10 invention. In the figures: 

Figure 1 diagrammatically shows the structure of a color film in cross section, 
Figure 2 shows the construction of a colorist's workstation in greatly 
simplified form, 

15 Figure 3 shows the spectral density of the blue, green and red color layers of a color 
film, 

Figure 4 shows a flowchart of the method according to the invention, 
Figure 5 shows color coordinates as a function of code values, 
Figure 6 shows a system according to an embodiment of the invention and 
20 Figure 7 shows a system according to an alternate embodiment of the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The invention provides a device and a method for color correction which, in 
25 comparison with the prior art, achieve an improved correspondence between the 
colors during reproduction with different representation means, 

The method according to the invention serves for the color correction of digital image 
data generated by spectral absorption of white light In color filters of a first 
30 representation means. Firstly, the primary color values of the image data are 

detected, the primary color values being related to the first representation means. 
The primary color values are then corrected in order to generate secondary color 
values, which are related to a second representation means and which take 

# 

• ■ ... ... 3 
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account of the absorption of light In secondary densities of the color filters. ' 
According to the invention, a plurality of absorption spectra are generated for 
different densities of at least one color filter. Building on this, the spectral profile of 
the absorption spectra of the color filters influences the correction of the primary 
5 color values for generating the secondary color values. 

One advantage of the method is that this achieves a better correspondence of the 
color reproduction between the first and second representation means. 

10 In a development of the invention, intermediate spectra are calculated from the 
plurality of absorption spectra for different densities of the coior filter. In this case, it 
may be expedient if a plurality of absorption spectra are generated for all the color 
filters. 

15 In this case/intermediate spectra may be calculated for all the color filters. As a 
result, more data are available for the correction of the color values, which may, in 
principle, have a favorable effect on the correspondence of the color 
representations that is striven for. 

20 Finally, provision may be made for convolving the spectra of the color filters with the 
spectral perception curve of a standard observer in order to generate the" secondary 
color values, in this way, it is possible to take account of the physiological 
perception of colors by the human eye. 

25 Efficient post-processing relies upon, by way of example, the color representation on 
the monitors of a colorist corresponds as exactly as possible to the image projected 
in a cinema, for example. Nowadays, the starting point for post-processing is 
generally digitized image data generated by film scanners or electronic cameras. 
Added to these are computer generated images which are present as digital image 

3o data from the outset. 
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Devices which strive for such correspondence between color representations with 
different representation means are already commercially available as software and 
hardware solutions. These devices are based on the considerations described below. 



5 Colors arise In different ways on different reproduction media. From the earliest 
times It has been known from painting that from just three different pigments, namely 
yellow, blue-green and purple-red, all intermediate hues can be produced by mixing 
the primary colors mentioned. Primary colors are understood to be those colors 
which cannot be mixed from other colors but from which ail other colors can be 
10 mixed. In chromatics nowadays this type of color mixing is referred to as subtractive 
color mixing. The term subtractive color mixing is derived from the fact that a 
pigment layer absorbs certain spectral components of incident white light and reflects 
others, as a result of which the color impression arises for the viewer. Other types of 
color mixing were initially not known. 

15 

It was not until a long time later that Isaac Newton recognized that the spectral colors 
of the light, the so-called color stimuli, can also be mixed. With this type of color 
mixing the jargon uses the term additive mixing in contrast to subtractive color mixing 
explained above in the case of pigments. Additive color mixing is governed by 
20 relatively simple rules, known as Grassmann's laws, which also apply to self- 
luminous screens, such as, for example monitors based on cathode ray tubes. 

A special case of subtractive color mixing is the combination or superposition of 
optical filters. The transmission of the filter combination is equal to the product of the 
25 respective transmissions of the individual filters, which is why the jargon also uses 
the term multiplicative color mixing in this case. This last-mentioned type of color 
mixing is also critical for color reproduction in the projection of color films which have 
three different color layers lying one above the other. 

30 Figure 1 dlagrammatically shows an example of the construction of a color film 1 in 
cross section. A layer carrier 2 carries three color layers 3, 4, 5 having the primary 
colors red, green and blue, the red-sensitive color layer 3 adjoining the layer carrier 2 
and the blue-sensitive color layer 5 forming the topmost color layer. A yellow filter 6 
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lies between the blue-sensitive and green-sensitive color layers 5 and .4. respectively. 
For the purpose of better illustration, the individual layers are represented spaced 
apart in figure 1 but in reality they adjoin one another. The intermediate layer for 
preventing interdiffusion of the green-sensitive and red-sensitive colorants is not 
taken into account here and is not Illustrated in figure 1 since it has no influence on 
the color behavior of the film which is essential to the present invention. 



One important difference between additive and multiplicative color mixing is that 
Grassmann's laws cannot be applied to multiplicative color mixing. The reason for 

io this is to be found in the fact that, by way of example, as the thickness of a cyan filter 
increases, there is a decrease not only in the transmission in the red spectral 
range but also to a considerable extent in the green spectral range. This fact 
and the resulting consequences are explained in detail further below. In 
known color correction systems, therefore, the absorption of test patterns 

15 ("test patches") is measured with the aid of densitometers and the absorption 
in the secondary densities is corrected by a transformation of the color 
coordinates. 

It has been shown in practice, however, that despite these measures, the. 
20 correspondence of colors is not always achieved during reproduction with 
different representation means. 

Figure 2 illustrates a colorlst's workstation in greatly simplified form. In the 
course of film production, a first copy is made from the film material originally 

25 exposed by the camera. The copy is used to produce further prints which 
form the starting point for the post-processing of the film. In figure 2, such a 
print is inserted in a film scanner 11. During the scanning of the print, the 
photographic Image information is converted into digital image data and fed to 
a device 12 for color correction, which is usually operated by a colorist. 

30 During the correction If the film material, the colorist views the image to be 
processed on a monitor 13. The color representation on the monitor 13 is 
determined by color values at the output of the color correction device. The 
color values at the output of the color correction device 12 are also forwarded 
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as control commands or "Code Values" to a film exposer 14, which exposes 
the data onto an Internegative film. The content of the internegative film is 
then transferred to a positive film by means of a contact copy. The positive 
film is symbolized by a film reel 16 in figure 2. In order to inspect the result of 
5 the exposed film, the latter is projected onto a projection screen 18 by a film 
projector 17. 

Ideally, the color representation of an image projected onto th.e projection screen 18 
corresponds to the color representation of the same image on the monitor 13. For 

10 approximation to this ideal case, a device 1 9 for adjusting the color coordinates is 
connected between the color correction device 12 and the monitor 13. The 
adjustment device 19 converts the "Code Values" sent to the film exposer 14 Into 
color coordinates for the monitor 13. The conversion has the aim of obtaining as far 
as possible identical color representations on the monitor 13 and the projection 

15 screen 18, respectively. The conversion method and the conversion device 19 are 
described in greater detail below. 

Figure 3 Illustrates spectral curves of In each case three color filters of different 
density for the colors red, green and blue. The density D is plotted, on the ordinate 
20 and the wavelengths in nanometers (nm) are plotted on the abscissa. The density D 
of a filter is derived from the transmission T thereof in accordance with the following 
formula: 



2S 



D = -log (T). 



This means that at density zero, the relevant filter is completely transparent, and that 
the transmission decreases as the density increases. Density curves for filters with 
different transmissions are plotted for each of the primary colors red, green and blue. 
It can clearly be seen that, for the density curves for the red filter, by way of example, 
30 appreciable secondary maxima occur In the blue spectral range around 400 nm, and 
lead to a considerable absorption for the color Impression. The same applies to a 
lesser extent to the density curves of the green filters. The density curves for the 
blue filters fall sharply in the wavelength range of between 440 nm and 380 nm in 
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order to rise again below 380 nm. Furthermore, the density curves of the blue filters, 
with increasing density, exhibit a more and more highly pronounced plateau in the 
green spectral range around 550 nanometers, the plateau projecting right into the red 
spectral range. The absorption of a primary color filter in spectral ranges other than 
5 the spectral range assigned to the respective primary color is referred to as the 
"secondary density" of the density curve and results fn color shifts during the 
projection of color films for example in the case of multiplicative color mixing. These 
effects are known in principle and are corrected .for example by means of a linear 
transformation of the color coordinates. In order to better understand the extent to 
10 which the invention goes beyond the known methods, it Is necessary firstly to discuss 
the conventional correction method in more detail. 

Different film materials differ inter alia in the absorption properties of the colorants, 
which makes It necessary to adjust the color correction device 12 shown in figure 2 to 

is a specific film material. For this purpose, the film exposer 14 exposes with 

predetermined code values so-called "test patches" i.e. image windows with different 
colors and color densities. This film material is then copied and produces the actual 
film. The test patches are then measured by densitometers In order to determine the 
absorption of a colorant in specific wavelength windows. The measurement 

20 characteristic of the densitometers is determined in accordance with DIN 4512-3 or. 
a corresponding International standard. From this, the absorption of the colorants 
results not only in the principle maxima but also in the secondary maxima. The 
values determined In this way form the basis for the subsequent transformation of the 
color values which define the representation on the colorist's monitor 13. The 

25 transformed color values are corrected color values which define the illumination 
commands of the film exposer 14 and thus determine the subsequent color 
representation on the projection screen 18. To put it another way, the color values or 
code values which control the film exposer 14 are "predistorted" in order to 
compensate for the "distorting" influence of the colorants of the film material 

30 used, 

It has been shown in practice, however, that the correspondence between the 
color representation on the monitor 13 and the projection screen 18 that is 
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striven for in this way still leaves something to be desired. The purpose of the 
invention is to improve said correspondence. 

In order to realize this aim, the invention commences at determination of the 
5 correction values. From the more precise consideration of the spectral density 
curves of the color filters as shown in figure 3, It is possible to derive further 
properties of the colorants which lead to color shifts. However, these 
properties cannot be identified by means of the densitometer measurements 
used in practice. This is because conventional densitometers permit only an 

10 integral consideration of the absorption properties of the colorants. Upon more 
precise consideration of the spectral absorption curves, a shift in the primary 
maxima toward shorter wavelengths can be discerned for all primary colors as 
the density increases. This shift S is represented using the example of the 
primary maximum for red in figure 3. Furthermore, the form of the density 

is curves also changes as a function of the densities. It is exactly in this way that 
it is thus possible to determine and correspondingly describe the spectral 
influences of the particular film treatments during the copying process and the 
development. 



20 In the case of conventional densitometer measurements, these changes are 
registered only as a change In the absorption in the respective measurement 
window. For this reason, it is not possible with densitometer measurements to 
determine the actual absorption at a specific wavelength. However, this is 
exactly what is important for as precise a correspondence as possible between the 

25 color representation on different representation means. 

The invention therefore proposes measuring the test patches of the film materials 
using a spectrometer over the entire wavelength range and interpolating intermediate 
spectra from the spectra thus obtained. From the totality of the spectra, it is possible 
30 to derive for the three primary colors, tables which put a color value that determines 
the representation on the colorisfs monitor 13 into a relationship with a code value of 
the film exposer 14. A three-dimensional table is produced overall In this way. 



I 



The method according to the invention is described in greater detail below with 
reference to figure 4. The starting point is formed by RGB color values which are 
output from the color correction device 12 to the monitor 13, on the one hand, and to 
the film exposer 14, on the other hand. In order to obtain a standardized color 
reproduction on the monitor 13, a so-called look-up table for the monitor LUT (M) is 
stored in the adjustment device 19, said table taking account of the reproduction 
properties of the monitor. In accordance with the flowchart in figure 4, the film is 
exposed in the film exposer In accordance with these RGB values. Said film is then 
copied onto the material to be projected. The color patterns or patches generated in 
this way are measured spectrally In a step. 22. In addition to these measured spectra, 
further intermediate spectra are calculated in a step 23. The totality of the spectra 
generated in this way are convolved with the perception curves of a standard 
observer in a step 26 in order to generate color coordinates X, Y, Z corresponding to 
the RGB values. The color coordinates X, Y, Z are finally linked with an "inverted" 
look-up table of the monitor LUT(M)" 1 in a step 27. This produces new color values 
R\ G\ B'. The influence of the film material on the color reproduction can be 
derived from the differences between the color values R, G, B and R\ G\ B*. 
Further look-up tables are therefore generated from said differences and are stored 
in the adjustment device 1 9 and kept ready for application to the color values RGB. 
What is achieved in this way is that the color representation on the monitor 13 
corresponds very well to the color representation on the projection screen 1 8. 

Figure 5 shows the profile of one of the color coordinates X, Y, X as a function of 
the code values of the film exposer. The color coordinates are measured from the 
transmission of grey patches on the film material. The result permits a statement 
about the density distribution as a function of the code values, which is likewise 
taken into account In the calculation of the corrected color values R', G«, b\ 

Fig. 6 Illustrates a system 700 according to an embodiment of the invention. 
System 700 provides a color management system. In one embodiment of the 
invention, the displayed image Is displayed on a projection screen by projecting the 
image from a digital projector. Other embodiments of the invention display Images 
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on high definition monitors and display apparatus, cathode ray tube (CRT) type 
displays and any other display apparatus suitable for displaying video images. 

A color conversion unit adjusts the colorimetrio properties of the displayed images 
based on display device colorimetrlc characteristics and reference characteristics. 
Reference characteristics characterize images as they would appear in other 
circumstances, for example, on other display types. In that manner the colorimetrlc 
response of the display is adjustable to provide displayed images in accordance 
with a wide variety of selectable video image viewing experiences. In one 
embodiment of the invention, reference images comprise user selectable 
colorimetrlc response characteristics for the displayed image. 

Therefore, selectable ones of a variety of "looks" for displayed images can be 
achieved, taking into account a plurality of characteristics that vary from 
circumstance to circumstance. For example, characteristic "looks" are affected by 
characteristics of display apparatus in use, ambient lighting conditions, image 
source device characteristics, desired film looks, projection screen types, and 
source image characteristics, to name but a few characteristics. In addition, the 
invention facilitates maintaining a consistent Image look in a given display 
environment, regardless image processes and processing techniques, equipments 
and capture and storage media. 

Video image source 750 (not shown) is coupled to digital projector 701 via color 
conversion unit 708. In one embodiment of the invention, reference image source 
702 provides calibration images, referred to herein as "patches" to digital projector 
701 for projection of the patches onto projection screen 704. In one embodiment of 
the invention, respective patches are projected onto screen 704 as part of a 
calibration process according to an embodiment of the invention. 

Conventional calibration methods have drawbacks. On one hand they can be 
accurate, but time consuming, involving uniquely skilled human Intervention. These 
conventional techniques depend heavily on.film projection conditions. On the other 
hand, some conventional calibration methods are less accurate and very 



A MPMni=n cuccT 




OTB PATENT DEP4^|M-M AMY 




NR. 650 




PCT/IB 0 4/0386$ 



ll . 

approximate. These methods introduce artificial distortions that are unacceptable to 
a professional film industry operator. 

A calibration system and process of an embodiment of the Invention comprises a 
g set of color patches, for example, as created on 35mm film. This set of color 
patches provides a color reference sample. Using the technique of the Invention, 
the color patches are capable of reproduction across various facilities using the 
same film process standard. This technique provides a valuable reference sample 
for display calibration. According to an example method of the invention, this 
io technique includes detecting and correcting distortion. Distortion arises, for 
example, from film non-uniformity and projection light system non-uniformity. 

According to an embodiment of the invention, a patch design is provided that 
allows for very short data capturing campaigns. 



In one embodiment of the invention sampling patches are processed so as to 
provide measurement reference points, as well as interpolated points, for a three 
dimensional (3D) look-up table (3D-LUT). Based upon the LUT, Images projected 
by projector 701 are adjusted to achieve a selected "look" for the images. In one 
20 embodiment of the invention, a 3D-LUT is provided with 256 x 256 x 256 control 
points for any given color space. 

Calibration processor 705 analyzes reference colorimetric characteristics and 
compares the reference characteristics to selected characteristics, for example, 
25 projector type, lens type, projector lamp output and the like. In one embodiment c 
the invention, reference characteristics are manually provided to calibration 
processor 705 by a human operator. In other embodiments of the invention, 
reference characteristics are stored In a memory (not shown) of calibration 
processor 705. 

30 

In one embodiment of the Invention, reference characteristics comprise 
characteristics corresponding to devices to be emulated by screen 704. For 
example, one set of reference characteristics enables projector screen 704 to 
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emulate an HD monitor. Another set of reference characteristics enables projector 
screen 704 to emulate a conventional CRT. Conversely, for a display device 704 
comprising a conventional CRT, a set of reference characteristics enables dlsptay 
704 to emulate a film projector. In one embodiment of the invention, reference 
5 characteristics corresponding to display devices are stored in a reference database. 
System 700 refers to selected reference device characteristics and to display 
device 704 color space response capability to generate a customized LUTfor 
displaying images on display device 704 so as to emulate a display device different 
that display device 704. 
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In still further embodiments of the invention, calibration processor 705 Is provided 
with reference characteristics by a remote source of reference characteristics (not 
shown). Remote sources are selected from the group comprising centralized 
databases, remote computing systems, local area networks, and wide area 
networks such as the Internet, to name but a few. Remote sources are coupled to 
calibration processor 705 by suitable means. Examples of suitable means include 
the Internet, wireless transmission means, and cable, telephone, satellite and other 
transmission means. 

Calibration processor 705 determines color offset information to be provided to 
color conversion unit 708 based upon the comparison. In one embodiment of the 
invention, calibration processor 705 uses the color offset information to generate a 
LUT. The generated .LUT Is provided to color conversion unit 708. Thereafter, 
color conversion unit 708 operates on images supplied by Image source 750 (not 
shown) In accordance with the generated LUT. The adjusted images are output 
from color conversion unit 708 and provided to projector 701 . Projector 701 , in turn, 
projects the adjusted images on projection screen 704. 

Color Conve rsion unit 708 

Calibration processor 705 provides automated and substantially real-time color 
calibration adjustments of a display device, for example, a digital cinema projector. 
This feature provides the capability to emulate a film look consistently and reliably 
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over time and distance. For example, an embodiment of the invention comprises a 
plurality sites using the same system. Therefore, systems and methods of the 
invention will find numerous applications in the post-production and digital 
intermediate world. 

Other embodiments of the invention comprise a color management unit coupled to a 
plurality of display devices 704. The color management unit manages a plurality of 
LUTS, display devices, data sources, projectors etc. In one embodiment of the 
invention, calibration processor 805 includes controls, operable by a user to 
manage a plurality of display environments, and to select display devices, emulation 
devices and color settings. 

According to one embodiment of the invention, the adjusted Images are then 
verified for proper colorimetry. According to one embodiment of the invention 
system 700 records a history of calibration settings and adjustments, for 
example in a database, thereby facilitating investigation of display events of 
interest to users, maintenance personnel, color technicians and system 
designers. 

Example 2: Post Prod uction Imaoe Processing 

A photographic Image captured on film contains a huge amount of information. 
Even today t there is no other medium capable of storing all this Information 
without compromising aspect ratio, resolution, color space and contrast ratio. 
While a digital video image is distributed as a real time stream in a fixed format 
between equipment, data is handled as computer files which are subject to open, 
save, import and export functions. Many of these operations transform the 
original image data into different formats of color spaces. 

The operator working via a simplified graphical user interface is rarely involved in 
the technical aspects of these operations. Therefore it is not transparent what 
alterations are being applied to the original image data. Often judging the final 
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"filmed out" results can be very disappointing because the results bear little 
resemblance to what the artist derived on his graphic display device. 

Usually the calibration process is either accurate and time consuming, involving 
uniquely skilled human intervention and very dependant on the film projection 
conditions, or it is very approximate and introduces many artificial distortions that 
are unacceptable to a professional film industry operator, because not enough 
measurement patches and points are taken into account. 

Working with film in the digital domain relies on consideration of a wide variety of 
parameters to keep the original scanned information as transparent as possible 
through the entire post production chain. The aim is simple: to ensure that the look 
of the images as viewed on a grading display, is the same look recorded on the final 
output medium and displayed to a viewing audience. Final output medium ranges 
from film deliverables to the entire variety of today's SDTV, HDTV and DTV video 
formats as well as DVD and Internet content. Another goal is to ensure the look 
viewed on the grading display and recorded on the finai output medium is the same 
look displayed to a viewing audience, regardless of display device. 

There follows a description with reference to Fig, 5 of a portion of a cinema 
laboratory processing system 20 according to one embodiment of the Invention. 

The processing system 20 depicted in Fig, 5 comprises an image scanner 21 such 
as is used to digitize, for example, a silver film. The digital data corresponding to 
the film Is stored in memory, for example, in a memory of computer 22. One 
embodiment of processing system 20 further comprises a digital projector 23 by 
means of which the film is projected In a laboratory screening room for approval by 
the director. In that case, the projector 23 receives video data recorded by the 
computer 22. 

A video data processing device 103 is used to receive video data provided by 
computer 22 based upon the output of scanner 21. Video data processing device 
103 transmits outgoing video data to digital projector 23. In some embodiments of 
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the invention, processing device 103 is substantially similar to device 2 described 
hereinabove. 

According to alternative embodiments of the invention, the digital data 
s corresponding to the film is provided to a display device in, for example, a 
broadcast television monitoring suite. Class one video monitors are the typical 
chojce for image display and monitoring of an output medium in such an 
environment. In one embodiment of the invention, the output is deliverable in a 
television format selected from the group comprising SDTV, HDTV and DTV 
10 standards. This format ensures that the images meet required broadcast 

standards. However, the color space afforded by such devices is somewhat limited 
compared to film. A conventional approach to achieving consistency in that case is 
to standardize CRT phosphors to ensure the video is reproduced consistently on a 
wide range of monitors manufactured to the corresponding standard. 

15 

Current standards for television monitoring include: SMPTE S170m for NTSC 
environments, ITU-R 601 for European environments (PAL / SECAM), and Sony 
BVM D24EIWU ITU-R BT.709 for HDTV (720 / 1080 line standards) environments, 
and SMPTE S240m for HDTV (1125 line standards) environments. 

20 

In a broadcast video monitoring embodiment, video data processing device 103 is 
receives video data provided by computer 22, or other source of broadcast video 
data. Video data processing device 103 transmits outgoing video data to a studio 
monitor 23. In some embodiments of the invention, processing device 103 is 
25 substantially similar to device 2 described hereinabove. 

The embodiments of the invention described above provide control and correction 
of color settings of digital display and projection devices, while matching the 
displayed colors with those of a reference color space, such as film. In particular, in 
30 digital post-production, digital intermediate processing, and broadcast studio 
environments, the invention provides control and correction of color settings of 
video monitoring display devices, while matching the displayed colors with those of 
other reference color spaces. Therefore embodiments of the invention provide 
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control and correction of the color settings of a digital display or projection device, 
while accurately controlling the matching of the displayed colors with those from a 
film or any other reference color space for use in digital post-production and digital 
intermediate processing environments. 

Fig. 7 illustrates a color management system 900 according to an embodiment of 
the invention, Color management system 900 comprises at least one video image 
source 950 (not shown), at feast one source of reference Images, e.g. reference 
color patches 902, at least one color conversion unit 908, at least one display 
device, for example projector 901 together with it least one projection screen 904, at 
least one calibration control unit 903, and at least one calibration processor 905. 
System 900 further comprises a color management unit 980. 

Color management unit 980 comprises a display characterization unit 906, a film 
stock characterization unit 926, an emulation unit 924, a library unit 930, a look 
merging unit 932 and an RGB-RGB LUT loading unit 920, Display characterization 
unit 906 comprises a store, for example a database, comprising look up tables 
(LUTs). The LUTs comprise sets of color characteristics corresponding to display 
device color space conversion operations. That is, the LUTs provide information for 
converting a first color space, for example, an RGB color space, into a second color 
space, for example an XYZ color space, for a plurality of devices and color spaces. 



Color Convers ion Unit 908 

A video image source 950 (not shown) is coupled to a display device 901 , for 
example a digital projector, via a color conversion unit 908. Also coupled to color 
conversion unit 908 is color management unit 980. Based on information provided 
by color management unit 980, color conversion unit 908 adjusts the video images 
from image source 950. 

According to one embodiment of the invention, color conversion unit 908 comprises 
at least one Look Up Table (LUT) stored in a memory (not shown) of color 
conversion unit 908. In another embodiment of the invention color conversion unit 
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908 comprises an LUT provided by RGB-RGB LUT loading unit 920 of color 
management unit 980. In one embodiment of the invention, color conversion unit 
908 implements a 3X3 matrix operation (M). The LUT performs a look up 
operation (L). In an embodiment of the invention, color conversion unit 908 is 
implemented by a processor, in one embodiment of the invention, the look up 
operation is carried out by employing memory look up and addition operations 
only, without the need for further types of operations. This approach results in 
significant computation savings compared to algorithms requiring additional 
processing operations. 

For a pixel of incoming 950, the pixel having values In R, G and B, color conversion 
unit 908 provides a corresponding pixel having values R' G' and B\ in one 
embodiment of the invention, R'G'B' are given by: 

is Mrr * Lr(R) + Mrg * Lg(G) + Mrb * Lb(B) 
G - Mgr * Lr(R) + Mgg * Lg(G) + Mgb * Lb (B) 
B' = Mbr* Lr(R) + MbG *Lg(G) + Mbb * Lb (B) 

In one embodiment of the invention, the values of R, G, B and their corresponding 
20 LUT transformed values Lr(R). Lg(G), Lb(B) are between minimum and maximum 
digital values. Thus matrix elements can be looked up from pre-computed values 
stored in memory, since the elements are constants. In an embodiment of the 
invention, a linear matrix transform is implemented by a more general transform as 
follows; 

R'= Mrr(Lr(R)) + Mrg(Lg(G)) + Mrb(Lb(B)) 
G'« Mgr(Lr(R)) + Mgg(Lg(G)) + Mgb(Lb(B)) 
0'* Mbr(Lr(R)) + Mbg(Lg(G)) + Mbb(Lb(B)) 

30 Therefore, each matrix element can be extended to a curve before multiplying by 
color values. Thus, the Invention provides the capability for "bending" or otherwise 
modulating color spaces. In one embodiment of the invention, the conversion unit 
is implemented in an FPGA, i.e., a hardware configuration. In an embodiment of 
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the invention, the color conversion unit 708 operates In real time and is capable of 
application to a plurality of standard input/output formats, Including, for example. 
HDSDI, and analog VGA. 

In an embodiment of the invention, color conversion unit 708 performs colorimetry 
transformation for a target display, for example, target Image displayers 230 of 
Figure 1 . In that embodiment, color conversion unit 708 is coupled between image 
capture device 210 and target image dispiayer 230 so as to operate on the image 
representation as image data is transferred from image source to display device. 
Embodiments of the invention achieve accuracy appropriate for a specific 
application by employing first or second or higher order polynomial approximation of 
the general transform. 

In one embodiment of the invention, color conversion unit 908 couples a 10 bit RGB 
source to a 10 bit display. Embodiments of the invention utilize 8 bit processing 
techniques. Some embodiments perform a 2 bit shift on the input signal (division by 
4). Furthermore, some embodiments of the invention utilize a 2 bits padding 
operation performed on the output signal (multiplication by 4). 

In one embodiment of conversion unit 908 of Figure 9, scalars are replaced by 
Look-Up Tables (LUTs) in a matrix product operation. In such embodiments, for 
example, if (R,G,B) is ah input triplet, the output triplet (R' ( , G\ B') is computed in 
accordance with: 



C 
B' 



r 



Lrr (R) Lm(G) Lrb(B) 
Lor (B) Laa(G) L G b(B) 
L B r (B) Lbg(G) L bb (B) 
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30 So as to Implement the relationship: 



Lm <R).R+L R a (G). G + L RB (B).B 
Lqr (R).R+ Lao (G), G + L ao (B).B 
35 I B' m L BR (R).R+ Lbo (G). G + Lbb (B).B 
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As each product depends only on one of R, G or B, it can be replaced by a more 
general LUT L' writing: 

L' RR (R) B L rr (R).R, L'rg(G)» L RG (G).G. etc... 
to implement the following equations: 
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35 



R> - L'at (R) + U*g(G) + L'rb<R) 
< O' - L'gr (R) + L'cg<G) +L' G j}(B) 
B' - Vbr (R) +L'bgW +L' BB (B) 

According to an embodiment of the Invention, for each output value (R\ G' or B') the 
processing steps implemented by conversion unit 908 comprise three look-up 
operations (one for R, one for G, one for B) followed by two additions. In one 
embodiment of the invention, each LUT table L'xy is coded using 8 bits. Diagonal 
elements (L'rr, Log, L'bb) comprise unsigned values between 0 and 255. Off- 
diagonal elements (L'r G , -L'rb, L'qr, Ugb, L' B r, L' bg ) comprise signed values 
between -128 and +127. In one embodiment of the invention, the output values R\ 
G* and B' are clipped between 0 and 255 (before 2 bits padding to be converted to 
10 bits). 

In an embodiment of the Invention, conversion unit 908 is implemented as a Field 
Programmable Gate Array (FPGA) and connected to 1920x1080 10 bits in and out 
video interfaces. 

In one embodiment of the invention, RGB-RGB loading unit 920 provides 9 Look-Up 
Tables L'rr, L' RGi L'rb, L'm L'gg, L' QB , U BR> L'bq, L'bb (in this order) of 256 values 
each to color conversion unit 908. 

Embodiments of system 900 (illustrated in Figure 9), include conversion unit 908 so 
as to provide color consistency from capture by capture devices 210 through 
conversion of the captured image into the digital domain as illustrated at 201 and 
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221 of Figure 1. Embodiments of the invention further provide means for recovering 
initial color parameters at any step in the post-production chain, and provide 
seamless visual control at any step using for a plurality of selectable target displays. 
In that manner, a consistent color reference is utilized for file exchange across 
5 facilities at any step of the process, 

The invention reduces the amount of expensive colorist's work for eaoh new 
version. One embodiment of the invention automatically adapts to different visual 
environments, for example, a theatre version for complete dark environment, a 
io broadcast version with scene contrast compression (to see the dark scenes in a 
dark living room). A DVD version is between broadcast and theatre versions 
(customer may want to turn the lights down in the living room). 

According to one embodiment of the invention, color conversion unit 708 operates 
is on incoming color image data (R.G.B) so as to provide outgoing color image data 
(R'G'B') in accordance with the relationships: 

R'= Mrr * Lr(R) + Mrg * Lg(G) + Mrb * Lb(B) 
G'= Mgr * Lr(R) + Mgg * Lg(G) + Mgb * Lb(B) 
20 S'« Mbr * Lr(R) + Mbg * Lg(Q) + Mbb * Lb(B) 

wherein R is a red value of said first color Image, G is a green color value of 
said first color image, B is a blue color value of said first color image, M is a matrix 
operation and L is a look up table operation carried out upon red (R), green (G) 
25 and blue (B). 

The adjusted Images are provided to display device 901. In some embodiments 
of the invention, display device 901 displays the images directly on a display 904. 
In the embodiment of the invention illustrated in Fig. 9, display device 901 is a 
30 digital image projection device that projects the images onto a display screen 904. 

Embodiments of system 900 further comprise a reference image source 902. 
Reference image source 902 provides calibration images, referred to herein as 
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"patches" to digital projector 901 for projection of the patches onto projection screen 
904. In one embodiment of the invention, respective patches are projected onto 
screen 904 as part of a calibration process. Calibration processor 905 provides 
calibration results for projector 901 to color management unit 980. Color 
5 management unit 980 stores he calibration results in a display calibration unit 906. 
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What is claimed, is 

1 . A method for the color correction of digital image data generated by spectral 
absorption of white light in color filters of a first representation means, the 

5 method comprising the following steps: 

a) detection of the primary color values of the image data, the primary color values 
being related to the first representation means, 

b) correction of the primary color values in order to generate secondary color 
values, which are related to a second representation means and which take 

lo account of he absorption of light in secondary densities of the color filters, 
wherein 

c) a plurality of absorption spectra are generated for different densities of at 
least one color filter, and 

d) the spectral profile of the absorption spectra of the color filters influences the 
15 correction of the primary color values for generating the secondary color values. 

2. The method as claimed in claim 1 , wherein intermediate spectra are 
calculated from the plurality of absorption spectra for different densities of the color 
filter. 

20 

3. The method as claimed in claim 1 , wherein a plurality of absorption spectra 
are generated for all the color filters. 

4. The method as claimed in claims 2 and 3, wherein intermediate spectra are 
25 calculated for all the color filters. 

5. The method as claimed in claim 4, wherein the spectra of the color filters are 
convolved with the spectral perception curve of a standard observer in order to 
generate the secondary color values. 

30 

6. The method as claimed In claim 4, wherein the transmission of neutral filters of 
different density of the first representation means Is measured in order to determine 
the density distribution of different .colorants in the first representation means. 
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7. A video system comprising: 

at least one input for receiving incoming video data, said incoming video data 
characterized by a first set of color characteristics; 

at least one output for delivering outgoing video data to a display device, said 
outgoing data characterized by a second set of color characteristics; 

at least one database storing a plurality of sets of color characteristics; 

at least one processor (15) coupled to said database for converting said 
incoming video data into outgoing video data as a based upon at least on of said 
sets of characteristics stored in said database. 



